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o: 

■ Abstract — In the coordination/consensus problem for multi-agent systems, a well-known condition of 
, achieving consensus is the presence of a spanning arborescence in the communication digraph. The 

paper deals with the discrete consensus problem in the case where this condition is not satisfied. 
A characterization of the subspace Tp of initial opinions (where P is the influence matrix) that ensure 

■ consensus in the DcGroot model is given. We propose a method of coordination that consists of: (1) the 
transformation of the vector of initial opinions into a vector belonging to Tp by orthogonal projection 
and (2) subsequent iterations of the transformation P. The properties of this method are studied. It is 
shown that for any non-periodic stochastic matrix P, the resulting matrix of the orthogonal projection 
method can be treated as a regularized power limit of P. 
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1. INTRODUCTION 



. In the last decade, the problem of reaching consensus in multi-agent systems has been the subject of 

00 I many works. For the basic results in the field, we refer to the surveys and monographs [Tl-lllj. 
^ I One of the first discrete models of reaching consensus was proposed by DeGroot [12]. Suppose that 

^T) ■ s(0) = {si, . . . , s^)""" is the vector of initial opinions of the members of a group and s{k) = {si, . . . , s^)""" 
is the vector of their opinions after the A;th step of coordination. In accordance with the DeGroot model, 
I s{k) = Ps{k — 1), /c = 1, 2, . . . , where P is a row stochastic influence matrix whose entry pij specifies the 
degree of influence of agent j on the opinior0 of agent i. Thereby, 



s{k) = P^siQ), A; = 1,2,.... (1) 

Consensus is [asymptotically] achieved if Imik^^s^ = s for some s € M and all i G {l,...,n}. 
It has been shown [T2] that consensus is achieved for any initial opinions if and only if the matrix 
P°° = limfc_!.oo P^ exists and all rows of are identical, which is equivalent to the regularitjH of P. 
Thus, reaching consensus in the DeGroot model is determined by the asymptotic properties of the powers 
of P and the initial opinions. 

If P is not regular, then the opinions do not generally tend to agreement. Yet, consensus can be 
achieved if the vector of initial opinions belongs to a certain subspace. Below we characterize this 
subspace and consider the method of projection which ensures that consensus is achieved even if the 
vector of initial opinions does not belong to the above-mentioned subspace. Furthermore, it is found that 



^ This work was supported in part by the Russian Foundation for Basic Research, project no. 09-07-00371 and the program 

of RAS Presidium "Mathematical Theory of Control." 
^ Thus, row i of P determines an iterative adjustment process for agent i's opinion; since P is row stochastic, the degrees 

of influence on each agent sum to 1. 
^ A stochastic matrix is said to be regular [13] if it has no eigenvalues of modulus 1 except for the simple eigenvalue 1. 

Regular stochastic matrices are also called SI A (stochastic, indecomposable, aperiodic). In the terminology of matrix 

analysis, we mainly follow |13II14) : in the terminology of graph theory we follow [15H17) . 
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the resulting matrix of the orthogonal projection procedure can be treated as a regularized power limit 
of the initial stochastic matrix. 

The paper is organized as follows. After introducing the terminology (Section[2|) and listing a number 
of well-known results used in the analysis of network dynamics (Section[3|), in Section[3]we discuss the 
conditions of reaching consensus in the DeGroot model. Section[5] characterizes the region of convergence 
to consensus for the DeGroot model. Sections[6HH] present the orthogonal projection procedure which 
generalizes the DeGroot algorithm and can be applied when this algorithm does not ensure that consensus 
is achieved. These sections also give the structure of the projection and the properties of the proposed 
method. In SectionlU we consider some non-orthogonal projections onto the subspace of convergence to 
consensus. In Section[8l we demonstrate that in the orthogonal projection procedure (as well as in the 
DeGroot algorithm), the nonbasic agents do not affect the final result. In sections [TO] and [T2l the case of 
the absence of nonbasic agents is studied and the main result is extended to the general case. Section [TT] 
briefly discusses the interpretation of the orthogonal projection procedure, and the final Section [13] deals 
with the concept of the regularized power limit of a stochastic matrix. 

2. BASIC NOTATION 

With a stochastic influence matrix P, we associate the communication digraph T with vertex set 
V{T) = {1, . . . ,n}. T has the (j, i) arc with weight Wji = pij whenever pij > (i.e., whenever agent j 
influences agent i). Thus, arcs in T are oriented in the direction of influence; the weight of an arc is the 
power of influence. 

The Kirchhoff matrix (see |16[I18|) L = L{r) = {lij) of digraph T is defined as follows: if j ^ i, 
then £ij = —Wji whenever T has the (j, i) arc and iij = otherwise; in = —J2k^i^ik, i = 1, . . . ,n. The 
Kirchhoff matrix has zero row sums and nonpositive off-diagonal entries. 

The matrices of this kind are sometimes referred to as directed Laplacians [19]. However, in a more 
precise terminology |18[ Section 2.2], the Laplacian matrix of a digraph is the matrix with zero row sums 
whose non-diagonal entries are defined by iij = —Wij, i.e., as distinct from the Kirchhoff matrix, the 
entries in the ith row are determined by the weights of the arcs outgoing frorcH i. Consequently, if all arcs 
of r are reversed, then the Laplacian matrix of the resulting digraph coincides with the Kirchhoff matrix 
of r and vice versa. Consequently, the Kirchhoff matrices and Laplacian matrices of digraphs form the 
same class. 

By virtue of the above definitions, for the digraph T associated with P we have 

m = i-p, (2) 

where / is the identity matrix. 

Any maximal by inclusion strong (i.e., with mutually reachable vertices) subgraph of a digraph is 
called a strong component (or a bicomponent) of this digraph. A basic bicomponent is a bicomponent 
such that the digraph has no arcs coming into this bicomponent from outside. Vertices belonging and 
not belonging to basic bicomponents can be called basic and nonbasic, respectively. Similarly, we call 
an agent basic/ nonbasic when the vertex representing this agent is basic/ nonbasic. Let b and be the 
number of basic vertices and the number of basic bicomponents in P, respectively. 

We enumerate the basic bicomponents and after them the nonbasic bicomponents. Furthermore, we 
enumerate the vertices in the first bicomponent, next the vertices in the second bicomponent, and so on. 
We shall assume that agents are numbered correspondingly. In this case, the influence matrix P and the 

Because of the similarity of these definitions, the Kirchhoff and Laplacian matrices are often confused. In the problems of 
decentralized control, either formalism can be used. If the analysis is based on the construction of the influence digraph (as 
in the present paper), it is convenient to use Kirchhoff matrices, while if the digraph of references (requests for information) 
is constructed whose arcs are directed oppositely, it is more convenient to use Laplacian matrices. 
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Kirchhoff matrix L have a lower block-triangular form called the Frobenius normal form. In the matrices 
P and L represented in this form, the upper-left blocks of size 6x6 correspond to the basic vertices of 
the communication digraph. These blocks will be denoted by P<s and L<s- 



P= ^ , L= ^ . (3) 





P<s and L<g respectively coincide with the influence matrix and the Kirchhoff matrix of the communication 
digraph restricted to the set of basic vertices/agents. 

The vertex set of any bicomponents is called a class. We also speak of the corresponding classes of 
agents. The vertex set of a basic bicomponent will be called a final clas^ |20j . 

If the DeGroot algorithm converges and vertex j is not basic, then, as noted in [12], column j in 
the limiting matrix P°° is zero and the initial opinion of agent j does not affect the limiting vector of 
opinions. 

3. USEFUL RESULTS FROM ALGEBRAIC GRAPH THEORY 

In this section, we present a number of results that are useful in the analysis of the DeGroot model 
and other network control models. In particular, they are used to prove the subsequent theorems and 
propositions (the proofs are given in the Appendix). 

First, if the sequence of powers P^ of a stochastic matrix P has a limit P°°, then 

P°° = J, (4) 

where J is the normalized matrix of maximum out-forests of the corresponding weighted digraph F (a 
corollary of the matrix tree theorem for Markov chains |21j). 
The matrix J is equal to the matrix Jn-u defined recursively: 

Jk = I — k ^r^^ — , where k = 1, . . . ,n — v, Jq = I, and LJn-v = (5) 

tr(LJfc_i) 

(see [231 Section 4] or [181 Section 5]) and can also be found by passage to the limit: 

J = lim (/ + rL)"i (6) 

(Theorem 6 in [22]). 

Furthermore, since L = I — P, we have 

P^L = LP°° = (7) 

and 

AA(P°°) = 7^(L), n{pn = ML), (8) 

where Af{A) and Tl{A) are the kernel (null space) and the range of A, respectively (see, e.g., \23\ Sec- 
tion 5]). Moreover, P°° is the eigenprojectiorO (principal idempotent) of L [26p27] and 

rankP°° = i/; rankL = n — i/, (9) 



* In the above context, this definition may seem illogical, since a basic bicomponent does not allow arcs from outside. 
However, it is justified by the fact that in the Markov chain determined by the influence matrix P, transitions occur not 
in the direction of the arcs of influence, but rather in the direction of agents that influence. Thereby, "all roads lead to" 
the basic bicomponents, and the union of final classes is exactly the set of essential states of the corresponding Markov 
chain. 

^ On the methods of computing eigenprojections, see, e.g., |24II25) . 
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where v is the number of basic bicomponents in T j22| Proposition 11]. It follows from ([9]) that 

dimA/'(i) = V, (10) 
where dim7\A(L) is the dimension of the kernel (the nullity) of L. Finally, by [18^ Proposition 12], 

M{L)nn{L) = {o}, (11) 

indL = l, (12) 

where indL (the index of L) is the order of the largest Jordan block of L corresponding to the zero 
eigenvalue, and by (fTOl) and (fT2]) . 

rriLiO) = (13) 
where 771^(0) is the multiplicity of as an eigenvalue of L. 



4. CONDITIONS FOR CONVERGENCE TO CONSENSUS IN THE DEGROOT MODEL 

As noted in the Introduction, the DeGroot algorithm converges to consensus for any initial opinions 
if and only if there exists a limiting matrix P°° = lim^^oo having all rows equal. According to the 
ergodic theorem for Markov chains, a necessary and sufficient condition for this is, in turn, the regularity 
(the SIA property) of P. 

The equality of all rows of amounts to 

= iTT^ (14) 

with some probability vector (the components are non-negative and sum to 1) vr, where 1 = (1, . . . , 1)""". 
In this case, the consensus s is expressed by the inner product of the vectors vr and s(0): 

s{oo) = P°°s{0) = l7rTs(0) = Is, (15) 

where s(oo) is the limiting vector of opinions, vr is the limiting weight distribution of the DeGroot 
algorithm, and s = -7r'''s(0) is the consensus. 

A probability vector vr is called a stationary vector of a stochastic matrix P if it is a left eigenvector 
of P corresponding to the eigenvalue 1: ir'^P = vr^. Obviously, this condition is satisfied for the vector 
IT in the representation P°° = Itt"^ of P°°, provided that the convergence of the DeGroot algorithm to 
consensus is guaranteed by the regularity of P. 

By Theorem 3 in [12], if for any vector of initial opinions s(0), the DeGroot algorithm converges to 
the consensus -7r"''s(0), theiifl vr is a unique stationary vector of P. 

Let us mention some sufficient conditions [12] of the convergence of P^ {k oo) to a matrix with 
identical rows. One of them is the presence of an entirely positive column (stochastic matrices with at 
least one positive column are called Markov matrices) in P'^ for some k. Another sufficient condition is 
that all states in the Markov chain corresponding to P are mutually accessible (in this case, F is strongly 
connected and the agents belong to the same class) and P is proper [13] (which means that P has no 
eigenvalues of modulus 1 that are not equal to 1); in this case, P is said to be primitive. 

A criterion of convergence to consensus for the DeGroot algorithm can also be formulated in terms of 
the communication digraph F. The equality of the rows of P°° is equivalent to rankP°° = 1. Therefore, 
owing to Q, when the sequence {P^} converges, consensus is achieved for any initial opinions if and only 
if the communication digraph F corresponding to P has a single basic bicomponent (ly = 1). Consequently, 

® In fact, already in [TH] (§ 7 of Chapter 13) it was observed that if P is regular, then the vector tv can be uniquely recovered 
from the equation n — P n and each row of P°° = linife^oo P is the transpose of n. 
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provided that the sequence converges, = 1 is equivalent to the regularity of P. In turn, by ()13p . 
this is the case if and only if is a simple eigenvalue of L. 

Finally, = 1 if and only if F has a spanning out-tree (also called arborescence and branching) |22t 
Proposition 6] . In this case (see(j3|)), = (p^) = J = {Jij) is the normalized matrix of spanning 
out-trees [22] : 

PTj ='^3 = Jij = hj = '^,---,n, (16) 

where tj is the total weighJll of F's spanning out-trees rooted at j and t is the total weight of all spanning 
out-trees of F. It follows from (|15|) and p6|) that in the case of guaranteed consensus, 

.-=(^,...,^).(o)=t-^x:t,4 

A survey of some results on the DeGroot model and its generalizations can be found in [11[5]. Note 
that one of the applications of the DeGroot model is information control in social networks [28]. 

5. THE REGION OF CONVERGENCE TO CONSENSUS OF THE DEGROOT ALGORITHM 

Consider an influence matrix P whose powers converge tcH P°° , but the rows of P°° are not necessarily 
equal. 

In the vector space of initial opinions s(0), let us find the subspace Tp whose vectors are transformed 
by into vectors with equal components. Obviously, the DeGroot algorithm ([T|) with a proper matrix P 
leads to a consensus if and only if s(0) € Tp. That is why Tp will be referred to as the region of convergence 
to consensus of the DeGroot algorithm ([T]). In Section[6l we will present a consensus procedure which 
consists of two steps: on the first step, the vector of initial opinions s(0) Tp is replaced by the nearest 
vector in Tp; on the second step, the algorithm ([T|) is applied to the result of the first step. 

The following theorem characterizes the subspace Tp. 

Theorem 1. // the powers P^ of the stochastic matrix P converge, then Tp = TZ{L) © Ti, where Tp 
is the region of convergence to consensus of the DeGroot algorithm ([T|), L = I — P, and Ti is the linear 
span of the vector 1 = (1, . . . , 1)^. 

Now we reformulate Theorem[T]in a different form. 

Corollary 1. Suppose that the powers P^ of the stochastic matrix P converge and L = I - P. Let L^*) 
and M^'^ be the matrices resulting from L by substituting 1 for the ith column and adding ^1, where 

^ € M \ {0}, to the ith column, respectively. Then Tp = 7^(L^'^) = TZ{M^^) for any i = 1, . . . ,n. 

To prove Corollary[Tl it is sufficient observe that any column of L is equal to the sum of the remaining 
columns taken with the minus sign. Consequently, its removal does not affect the linear span of the 
columns. Thus, ']Z{L^^^) = TZ{L) © Ti and so Tp = TZ{L^^^) is equivalent to the assertion of Theoremdl 
Similarly, TZ{M^^'^) = TZ{L) © Ti, and Tp = TZ{M^'') is also equivalent to the assertion of Theorem[TJ 

Remark 1. Corollary [1] can also be formulated as follows: s(0) € Tp if and only if either system 
of equations L^^^x = 5(0) or M^'^x = s(0) is consistent. Indeed, the consistency of these systems is 
tantamount to s(0) e 7^(T(*)) and s(0) € 7^(Mg^*^), respectively. 

^ The weight of an out-tree (and, more generally, of a digraph) is the product of the weights of all its arcs. 

* This assumption is not too restrictive. It is satisfied, e.g., if every final class has at least one agent taking into account its 

own current opinion in the iterative adjustment of its opinion. More generally, the limit P°° exists [13] if and only if P is 

proper, i.e., P has no eigenvalues (7^ 1) of modulus 1. 
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Corollary 2. Let U be any matrix obtained from L by (1) deleting, for each final class, one column 
corresponding to some vertex of this class and (2) adding 1 as the first column. Then the columns of U 
are independent and Tp = TZ{U). 

Remark 2. Owing to Corollary[2l the n — b columns of L corresponding to the nonbasic vertices are 
linearly independent. Therefore, for U to remain a matrix of full column rank, they can be replaced 
by any n — b independent columns with zeros in all "basic" rows (see also Proposition[T] and Corollary^] 
below). 

Using ([8]) and ^ the region Tp of convergence to consensus can also be represented through the kernel 
of = J. 

Corollary 3. Under the assumptions of Theorem^ Tp = J\f{J) ©Ti. 

Remark 3. According to ([9]) rank J = z/. By virtue of [13\ (102) in Chapter 13], P°° = J has a lower 
block-triangular form. Moreover, its submatrix corresponding to the basic vertices is block-diagonal: 
every basic bicomponent is represented by a diagonal block with equal rows. Therefore, AfiJ) is the 
orthogonal complement of the linear span of u columns of j"^ taken one from each diagonal block repre- 
senting a basic bicomponent. 

The following proposition enables one to "locate" the subspace Tp. 

Proposition 1. Let x € M". Then x € Tp <^ Xig € Tp^, where Xt^ is x with the nonbasic components 
removed. 

By the definition of Tp, to prove Proposition[Tl it is sufficient establish that P°°x = al„, <^ {Pfs)°°x<^ = 
all), where a € M, {P<s)°° = ^^^k-^oo{P<3)^ i and the vectors 1 are supplied with their dimensions as a 
subscript. This equivalence can be easily deduced from the following properties of the matrix P°° 
(see [13\ (102) in Chapter 13]): (1) the submatrix of P°° corresponding to the basic vertices coincides 
with {P<q)°°; (2) the last n — b columns of P°° consist of zeros; (3) the last n — b rows of P°° are convex 
combinations of the first b rows. 

Corollary 4 (of Proposition!!]). The region of convergence to consensus of the DeGroot algorithm has 
the form Tp = Tp^ x 

Example 1. Consider the multi-agent system whose communication digraph T is shown in Fig.[Tl 
For simplicity, Fig. 1 does not show loops (every vertex has a loop whose weight sums to 1 with the 

weights of all arcs entering this vertex). 

The basic bicomponents of F are the restrictions of F to the classes {1, 2, 3} and {4, 5}; the class {6, 7} 

is nonbasic. Matrices P and L = I — P ol the communication digraph F are as follows: 
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Fig. 1. The communication digraph F of a multi-agent system. 



We construct the matrix U (see Corollary[2|) by removing the first and the fourth column of L and 



adding 1 as the first column; also find the matrix P°° = J by using ([5]) or ([6]) or by computing lim^^oo P 
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(17) 



(in P°°, all entries, except for the decimal values in the last two rows, are exact). 

According to Corollary[2l U has full column rank and the linear span of its columns coincides with 
the region of convergence to consensus of the DeGroot algorithm: TZ{U) = Tp. Finally, according to 
CorollaryO and Remark[3l Tp is the direct sum of Ti and the orthogonal complement of the linear span 
of the vector^ 

= (0.4 0.4 0.2 0)"^ and n"^ = {0 0.4 0.6 O)^, (18) 
obtained by transposing the rows of P°° corresponding to the different final classes. 



6. THE ORTHOGONAL PROJECTION METHOD 

If P is not regular, then Tp ^ M"", i.e., there are vectors of initial opinions not driven to consensus by 
the DeGroot algorithm. Consider the case where consensus is still needed. How can it be reached? A 
natural suggestion is to enrich the communication digraph with additional links that will ensure regularity 
of the matrix P and to perform the iterative adjustment of opinions with the new matrix. However, one 
can imagine a situation where communication between agents is their prerogative and the only thing the 
"center" may suggest (or theoretically consider) is a certain correction of the initial conditions s(0). In 
what follows, we consider mathematical and algorithmic aspects of this approach. 

As shown above, to ensure reaching consensus by means of the DeGroot algorithm with matrix P, 
it is necessary to transform the vector s(0) into some vector s'(0) € Tp. In doing so, it is desirable to 
minimize ||s'(0) — s(0)||, where ||-|| is the Euclidean norm. 

The transformation mapping any vector s(0) into the closest vector in Tp is the orthogonal projection 
of onto Tp (along the orthogonal subspace Tp). According to Lemma 2.3 in [29] this projection is 
given by a symmetric idempotent matrix; we will denote it by S. 

^ Here, the row vectors are represented in a "matrix" form, i.e., their components are separated by a space. 
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If the initial conditions are adjusted by means of the orthogonal projection S, then the limiting vector 
of opinions s(oo) can be represented as follows!^ 

s(oo) = P°°5s(0). 

This method will be called the orthogonal projection procedure for reaching consensus. The matrix 

oo 

P°°S will be referred to as the resulting matrix of the orthogonal projection procedure and denoted by P : 

oo 

P = P°°5. (19) 

By construction, the orthogonal projection procedure leads to a consensus for any vector of initial 
opinionj^g(O) (recall that Tp is the region of convergence to consensus of the DeGroot algorithm, while 

oo 

S projects M" onto Tp). Consequently, all rows of the matrix P are identical, i.e., there is a vector 
a = (ai, . . . , an)^ such that 

P = la^. (20) 

Vector a will be referred to as the weight vector of the orthogonal projection procedure. Thus, the proposed 
procedure can be written in the form 

s(oo) = P°°Ss{0) = Ps(0) = la^s(O) = Is, (21) 

where s(0) is an arbitrary vector of initial opinions, a is the weight vector of the orthogonal projection 
procedure, and s = a^s{0) is the consensus. 

Is a a probability vector? S is the projection onto the subspace Tp which by Theorem[T] contains 1. 
Consequently, S leaves 1 fixed, i.e., S has all row sums equal to 1. Given the fact that P°° is stochastic, 

oo 

we obtain that P = P°°S also has row sums 1, i.e., J27=i — 1- Observe, however, that S may have 
negative entries. Therefore, the answer to the question on the nonnegativity of the weight vector a is 
not immediately obvious. This question will be answered in Section[Tni This will enable one to interpret 

oo 

the matrix P as the regularized power limit of the stochastic matrix P. 



7. FINDING THE ORTHOGONAL PROJECTION 

Consider the properties of the projection S. It is known [29] that for any rectangular matrix A, the 
matrix AA~^ where A~^ is the Moore-Penrose generalized inverse of A, is the orthogonal projection with 
range TZ{A). 

Note that the matrix U defined in Corollary[2]has full column rank n — v + 1 and TZ{U) = Tp. Hence, 
owing to the above fact, the orthogonal projection S with range Tp has the expression S = UU~^ . To 
determine , we use the formula f7^ = {U'^U)~^U'^ (see, e.g.. Problem 2.17(d) in [29]) which for the 
matrix U of full column rank takes the form = {U'^U)~^U'^ . Consequently, 

S = UU+ = U{U^U)~^U^. (22) 

The following proposition clarifies the structure of S. 

^'^ Note that in finding s(oo), as well as in the DeGroot algorithm, there is no necessity to compute the powers of P: it is 
sufHcient to iterate the multiplication of P by vectors, starting with the vector Ss{0); the calculation of Ss{0) will be 
discussed below. 

" Formally, this can be proved as follows: by the definition of S, Theorem[Tl and Eq. (Q, TZ{P°°S) = {P°°5's(0) | s(0) G 
R"} = {P°°{Ly + al) I J/ e R", a € R} = {al I a G R}. 
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Proposition 2. The orthogonal projection S onto the subspace Tp has the form 

S = 




(23) 



where S<s is the orthogonal projection onto the region Tp^ 
algorithm with matrix -Rg . 



of convergence to consensus of the DeGroot 



Proposition!!] follows from CorollaryUl The nonbasic components of any vector do not alter when the 
vector is projected onto Tp, since any alteration would be contrary to the minimality of the distance to 
the projection. 

Computing, with the help of (j22p . the projection S for Example[T]we obtain 
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Substituting S and the matrix P°° 
projection procedure: 



J (|17p into (jl9p we find the resulting matrix of the orthogonal 



p = P'^S' = 1-^(26 26 13 18 27 0) R^l- (0.2364 0.2364 0.1182 0.1636 0.2455 0). (24) 

Note the following properties of the vector a = j^q (26 26 13 18 27 O) representing the matrix P in 
accordance with ([20]) : (1) the components of a corresponding to the basic vertices are strictly positive; 
the components corresponding to the nonbasic vertices are zero; (2) Yl'i=i = 1; (3) as the comparison 
of (j24p and (jlSp suggests, if vertices k and m belong to the ith final class, then ak/oim = '^kl'^^lw where 
TT* is the stationary vector of the influence matrix of the ith. basic bicomponent. 

The second property has already been proved in the general case (Section[6]). Later in this paper we 
will prove that the remaining properties hold true as well. 

Generally speaking, the orthogonal projection procedure makes a transition from the matrix P°° 

oo 

bringing each final class to its separate consensus to the matrix P establishing a common consensus. 



8. DO THE NONBASIC AGENTS AFFECT ANYTHING? 

As noted in the Introduction, if the DeGroot algorithm leads to a consensus, then this consensus does 
not depend on the initial opinions of the nonbasic agents. This property is inherited by the orthogonal 
projection procedure with the difference that under this procedure with a proper (aperiodic) matrix P, 
consensus is always achieved. This is stated by the following proposition. 

Proposition 3. In the case of a proper matrix P, the resulting vector of opinions s{oo) of the orthogonal 
projection procedure does not depend on the initial opinions of the nonbasic agents. 

Note that according to (j2ip . s(oo) = P°°s'(0), where s'(0) = S's(O). By Proposition[2l the components 
of s'(0) corresponding to the nonbasic vertices are equal to the corresponding components of s(0): the 
"preequalization" performed by the transformation S does not alter the opinions of the nonbasic agents. 

oo 

Proposition[3] immediately follows from the equation s{oo) = Ps{0) ()21|) and the following represen- 

oo 

tation of the matrix P. 
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Theorem 2. For any proper matrix P, vector a determining the resulting matrix P 
orthogonal projection procedure has the form 

a = (ai, . . . ,06,0, . . . ,0)'"', 

where [ai, . . . , ab) is any row of the matrix {P<s)°°S<s {see ^ and ()23|) ). 

The answer to the more general question "Is the result of the orthogonal projection procedure affected 
by the presence of nonbasic agents?" is also "No." 

Proposition 4. In the case of a proper matrix P, consensus s of the orthogonal projection procedure 
does not alter with the exclusion of nonbasic agents, provided that the initial opinions of the basic agents, 
as well as the weights of their influence on each other, are preserved. 

Proposition^ as well as Proposition[3l follows from Theorem[2]which implies that the vector (ai, . . . , ai,)'^ 

oo 

determining P does not alter with the exclusion of nonbasic agents. The properties of this vector will be 
summarized in Theorem[3] (Section llOp . 

Thus, under the orthogonal projection procedure, the only result of the presence of nonbasic agents is 
that finally their opinions come to the same consensus as the opinions of the basic ones. This consensus 
does not depend on the initial opinions of the nonbasic agents or even their presence. 



2467 

= la^ of the 



9. NONORTHOGONAL PROJECTION ON THE SUBSPACE OF CONVERGENCE TO 

CONSENSUS 

In the orthogonal projection procedure, iterative adjustment ^ is preceded by the projection of the 
vector of initial opinions s(0) onto the subspace Tp (preequalization). By virtue of Proposition[2l to 
find the orthogonal projection matrix S, the communication digraph can be restricted to the set of basic 
vertices. 

An alternative to /S is a stochastic matrix that transforms any vector of initial opinions into a vector 
in Tp and at the same time approximates P. It makes sense to additionally require that this matrix be 
idempotent, since otherwise it would alter some vectors already in Tp which do not need any preequal- 
ization. The problem of finding such a matrix has much in common with the classical problem of matrix 
approximation (see, e.g., [30] and [HI Section 7.4]). 

It can be shown that instead of S one can use the matrix S that has the first b rows equal to the 
corresponding rows of S and the remaining rows equal to the last n — b rows of P. More specifically, if 
^ P^ 0\ , „ / Sq3 ^ 
. B P^"^ ^= / 



p 



(see ([3]) and 1^), then 



S 





B D 



(25) 



S is not generally idempotent, however, since B 0, we have 

11^ -^Ib 



- S<s 




< 



B D-I 



\P-S\\ 



where H^Hb is the Euclidean norm of X, i.e., S is closer to P than S. On the other hand, since has 
a zero block corresponding to the nonbasic vertices (indeed, they correspond to the inessential states of 
the Markov chain determined by P; see \13\ (102) in Chapter 13]), we have P°°S = P°°S, consequently, 
the following proposition holds. 
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Proposition 5. // P is proper and S is given by (I25p . then the two-stage procedure of coordination 
consisting of the preequalization s'(0) = Ss{0) and the iterative adjustment s{k) = P'^s'(O), A; = 1, 2, ... , 
leads to the same consensus as the orthogonal projection procedure. 

As a consequence, we obtain that 7^(5) C Tp. It can be shown that if the nonsingularity of the block 
D is satisfied, then 7^(5') = Tp. 

Remark 4- Let us mention other specific transformations of the space of initial opinions M" into 
the subspace Tp. They do not require computing the orthogonal projection S. Owing to Corollary [1] of 
Theorem[Tl for the matrices L^^^ and M^*^ obtained from L by substituting 1 for the ith column and adding 

to it ^1, where ^ € R \ {0}, respectively, 7^(-L^*^) = TZ{M^^) = Tp holds. Thus, preequalization of the 

initial vector s(0) by means of either L^*) or M^'^ ensures achieving consensus in the subsequent iterative 
adjustment with P. However, it is easy to verify that this approach generates dictatorial procedures: 
they lead to a consensus that is equal to the initial opinion of the ith. agent if L^*^ or M^^ is used or is 
proportional to it (i.e., distorts it) in the case of M^*^ with ^ {0, 1}. Thus, this method is only good for 
the concealment of the dictatorial "coordination" of opinions. 

In considering other possible mappings of the space into Tp, the main advantages of the projection 
S should be taken into account, namely, that it guarantees the minimal difference between the initial 
vector of opinions and the result of its preequalization. 

The orthogonal projection S has the expression (I22p . In SectionfTOl we will obtain another explicit 
expression for S which is useful for studying the properties of the orthogonal projection procedure and 
its interpretation. 



10. THE ORTHOGONAL PROJECTION METHOD WHEN ALL AGENTS ARE BASIC 

According to Theorem[2] nonbasic agents do not affect the vector (ai, . . . , Uh)^ which determines the 
consensus in the orthogonal projection procedure. Therefore, all essential problems can be seen in the 
case where all agents are basic. This case is considered in the present section. 

Suppose, as before, that P is proper, limfc^oo = and the number of basic bicomponents is v. 
Since there are no connections between the basic bicomponents, in the absence of nonbasic agents the 
DeGroot algorithm is divided into v independent processes of coordination. It is interesting to see how 
the orthogonal projection procedure integrates these processes. 

Let mi be the number of vertices in the ith bicomponent. Its influence matrix, Kirchhoff matrix, and 
the power limit of the influence matrix we denote by Pi, Li = {i^y), and -Pj°°, respectively. In the absence 
of nonbasic agents, P, L, and have the form: 



fPi 



V 



P9. 



L 



V 



L, 



pc 



(Pi 



\ 



poo 
^2 



\ 



7 



(26) 



where the diagonal blocks correspond to the final classes and the entries not in these blocks are zero. 

The matrices correspond to the strongly connected digraphs, so (see the sufficient conditions of 
achieving consensus in Section[3|) all the rows of each of them are identical, i.e., these matrices can be 
represented in the form 

J>~ = l(7r*)T, i = l,...,z., (27) 

where (vr*)'^ is any row of 
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Consider the following problem: How is the weight vector a of the orthogonal projection procedure 
([2T]) related to the vectors vr*? 

Let q"- = 7f*-i-7f*, 2 = 2,...,!/, where vf* G M"" is vr* supplemented by zeros in the positions correspond- 
ing to all bicomponents, except for the ith. one. Define X as the matrix obtained from L by replacing 
the first column by 1 and the first columns of the blocks corresponding to the other bicomponents by 
the zero columns. Thus, X contains u — 1 zero columns and all other columns of X are independent, so 
rankX = n — u + 1 (see Corollary [2] to Theorem[l]). 

Now define Z as the matrix obtained from X by replacing the zero columns in the blocks with numbers 
i = 2, . . . , j> by the vectors g*. The form of Z with i> = 3 is presented in Eq. ([281) : 



/ 1 


^12 


^Imi 




.. 








. . 





\ 


1 

























1 
1 


.. 





" mi 


.. 

*12 




^lm2 





. . 
. . 








1 
























1 
1 


.. 
.. 









^m22 • • 

.. 


£2 




7r2 

"7712 

-4 


. . 

^12 




/3 




1 

























1 1 


.. 








.. 







^mz2 ■ ■ 


• ^mama 


/ 



(28) 



Lemma \. Z is nonsingular. 



By virtue of Lemma[T] and the proof of Theorem 2.8 in 
Tp satisfies 

s = xz-^. 



the orthogonal projection S with range 

(29) 



Substituting ([29]) into ([HD and using yield 

la'^ = p = p^S = P°°XZ-^. 



(30) 



Equation (j30p is used in Theorem[3] which summarizes some properties of the vector a, the weight 
vector of the orthogonal projection procedure (see (I2ip ). In particular, this theorem establishes a relation 
between a and the vectors vr* and matrix Z~^ (see (j27p and (|28p ). 



Theorem 3. // all agents are basic, then the following assertions hold: 

1. The row vector coincides with the first row of Z~^; 

2. All components of a are positive and J27=i '^i — 1- sum of the entries in any row of Z~^, 
except for the first row, is 0; 

3. Let c{g) he the number of the bicomponent containing vertex g. Then for g, h = 1, . . . ,n, 



ah 



a ~c(h)' 



where Pi = (i*)^/ X^ilL'il*?)^' ^ ^''"^ total weight of all spanning out-trees in the ith bicomponent 

of r and the total weight of those of them that are rooted at I, respectively. 
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Fig. 2. The communication digraph . 



Example 2. Restrict the communication digraph of Example[T]to the union of the final classes (Fig. [2]). 
In other words, consider the subsystem whose influence matrix and Kirchhoff matrix have the form: 



( 0.7 
0.1 
0.4 



V 




0.9 
0.2 





0.3 


0.4 








0.7 
0.2 






0.3 
0.8 ) 



/ 


0.3 





-0.3 









-0.1 


0.1 













-0.4 


-0.2 


0.6 



















0.3 


-0.3 













-0.2 


0.2 J 



The limiting matrix {P<b)°° = linifc-s>< 
which was found in Section[5] (see p!7|) ): 



^{P<b)^ of this subsystem is the "basic" submatrix of P°° = J 



( 0.4 0.4 0.2 \ 

0.4 0.4 0.2 

0.4 0.4 0.2 

0.4 0.6 

V 0.4 0.6 / 



Find the resulting matrix of the orthogonal projection procedure using ([29 
matrices X and Z defined above: 



X 



First, we construct the 



/ 1 





-0.3 





0^ 




/I 





-0.3 


0.4 




1 


0.1 













1 


0.1 





0.4 





1 


-0.2 


0.6 










1 


-0.2 


0.6 


0.2 





1 











-0.3 




1 








-0.4 


-0.3 













0.2 ) 












-0.6 


0.2 j 



Compute Z ^ and, using Eq. (|29]) . the projection S'^: 



z- 



1 


0.236 


0.236 


0.118 


0.164 


0.245\ 




/ 


0.818 


-0.182 


-0.091 


0.182 


0.273 \ 




-4.182 


5.818 


-2.091 


0.182 


0.273 






-0.182 


0.818 


-0.091 


0.182 


0.273 




-1.939 


1.394 


0.697 


-0.061 


-0.091 






-0.091 


-0.091 


0.955 


0.091 


0.136 




0.455 


0.455 


0.227 


-0.455 


-0.682 






0.182 


0.182 


0.091 


0.818 


-0.273 


V 


0.182 


0.182 


0.091 


-2.182 


1.727^ 




I 


0.273 


0.273 


0.136 


-0.272 


0.591 / 



S'fg coincides (see Proposition[2|) with the "basic" submatrix of the projection S found in Section[71 
The resulting matrix of the orthogonal projection procedure is given by ()19p : 



P 



(P(b)°°S'sb 



1- (0.2364 0.2364 0.1182 0.1636 0.2455). 



In accordance with Theorem^ Pig coincides with the "basic" submatrix of P (see (124p ). The first row 
of Z~^ coincides with any row of as stated in Theorem[3l 



AUTOMATION AND REMOTE CONTROL Vol. 72 No. 12 2011 



THE PROJECTION METHOD FOR REACHING CONSENSUS 



2471 



Thus, in the case where all agents are basic, the orthogonal projection method makes a transition 
from a series of local consensuses reached by applying the transformation (-P>b)°° to a global consensus 

oo oo 

established by P^. A relation between the vector a determining Pig with the vectors vr* that determine 
{P<s)°° is given by item 3 of Theorem[3l 



11. ON THE INTERPRETATION OF THE ORTHOGONAL PROJECTION METHOD 
An interpretation of the orthogonal projection method can be obtained using the following consequence 

oc 

of Theorem[3l a (the weight vector of the orthogonal projection procedure: P = la ) is a probability 
vector; in other words, it determines an impact distribution on the set of agents. Indeed, the resulting 
consensus is equal to the weighted mean of the initial opinions with weights taken from the distribution a. 

By Theorem[3l the relative weight of the ith vertex of the kth bicomponent in the distribution a is 
determined by (1) the fraction of the weight of out-trees starting from vertex i in the total weight of 
out-trees of the kth bicomponent (this fraction is equal to vr^) and (2) the relative uniformity of the kth 
bicomponent w.r.t. the weight of the trees starting from its vertices: it can be shown that the higher the 
uniformity, the grater /3j. This leads to the conclusion that the resulting opinion is maximally influenced 
by those leaders in the bicomponents who "broke away from their pursuers. " Note that Eq. (TO]) gives 
several expressions for ag/a^ which provide a number of variations in interpretation of agents' weights 
in the orthogonal projection procedure. 

In fact, the two-stage method consisting of the preequalization and the subsequent averaging using 
the influence matrix acts as if the basic bicomponents were combined into a single component by some 
additional arcs. In a subsequent paper, we shall specify what additional arcs lead to a result equivalent 
to the preequalization using the orthogonal projection. 

Note that enriching connections and finding the stationary vector of the stochastic matrix correspond- 
ing to the resulting digraph is the essence of the PageRank method [31]. In it, the links are added evenly, 
between all vertices and with equal weights. The structure of additional connections that emulates the 
orthogonal projection procedure is more complex. 



12. MORE ON NONBASIC AGENTS 

The projection S can be represented in the form ([29|) not only in the case where all agents are basic, 
but in the general case as well. For this, it is sufficient to apply the definitions of X and Z given in 
Section [To] to an arbitrary matrix L and use the proof of Theorem 2.8 in [29| . In this case, item 1 of 
Theorem [3| remains true. 

Below we "obtain a somewhat more general result. For the set of basic vertices, we define the matrix 
Xsg using the definition of X given in Section [TOj Now to define the matrix X for the whole set of vertices, 
we supplement X<^ with a zero block on the right, the block that corresponds in L to the nonbasic 
vertices, and an arbitrarily filled bloclQ G; let Z be the same extension of Z(q: 

Due to Lemma[T] in SectionfTOt Zig is nonsingular. According to the proof of Proposition 11 in [22], 
is also nonsingular. Therefore, Z is invertible. Using (|3ip . the Frobenius formula for the inversion of 
block matrices [H (86) in Chapter 2], ([29]), and ([23]) we find 

U L J 1^ -L-GZ- j - 1^ l)-[0 l)-'- 

^'^ Both the block G and the zero block on the right can simply be copied from the Kirchhoff matrix L. 
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Thus, the fohowing resuh holds (the second assertion is proved as in Theorem[3]). 



Proposition 6. 

1. In the presence of nonbasic agents, the orthogonal projection onto the subspace of convergence 
to consensus of the DeGroot algorithm has the representation S = XZ~^, where X and Z are defined 
in dsn). 

oo 

2. The row vector a such that P = la coincides with the first row of Z~^. 

13. THE REGULARIZED POWER LIMIT OF A STOCHASTIC MATRIX 
The meaning of Eq. (j30p . Theorem[3l and Proposition[6]is beyond the scope of the consensus problem. 

oo 

In particular, they state that for any proper stochastic matrix P, the matrix P = P^S is stochastic, has 

oo 

rank 1 (and thus all its rows are identical) and in the case where P is regular, P = P°°. 

oo oo 

Moreover, item 3 of Theorem[3] states that the components of the vector a that determines P [P = 
1q^) have a natural property, namely, within the same (ith) basic bicomponent, their ratio is equal to 
the ratio of the corresponding components of the vector vr*, the stationary vector of the bicomponent. 
Otherwise, if two vertices belong to different bicomponents i and j, then to obtain their ratio, the ratio 
of the corresponding elements of vr' and vr-' is to be multiplied by the ratio of specific "weights" of the 
bicomponents measuring their internal homogeneity. 

On the other hand, studying the problem of consensus leads to the conclusion that there are cases 
where it is useful to associate with a stochastic matrix P an adjusted power limit of rank 1, even though 
P can be not regular. 

oo 

These considerations allow us to call the matrix P associated with a proper stochastic matrix P the 
regularized power limit of P. The meaningfulness of this concept is supported by the following properties. 

Proposition 7. For any proper stochastic matrix P: 

oo 

(1) vector a such that P = la^ is a stationary vector of the matrix P: a^P = a^; 

oo oo oo oo oo 

(2) PP = PP = P'^P = PP°° = P. 

Item 1 of Proposition[7] follows from the fact that by item 3 of Theorem[3l a is a linear combination 
of the vectors vf^, . . . , vr'^ each of which is a stationary vector of P. Item 2 follows from item 1. 

Note that using the Cesaro limit limm_j.oo ^ J2k=i ■> the concept of the regularized power limit of a 
stochastic matrix can be extended to arbitrary (not necessarily proper) stochastic matrices. 

14. CONCLUSION 

In this paper, we considered the problem of reaching consensus in the case where the influence matrix 
appearing in the DeGroot model is proper, but not necessarily regular. To solve this problem, we 
propose the orthogonal projection method. On the first stage, this method projects the space of initial 
opinions onto the region Tp of convergence to consensus of the DeGroot algorithm; this stage is called 
preequalization. On the second stage, the result of the first stage is transformed into consensus by the 
iterative adjustment with the initial influence matrix. The subspace Tp is the direct sum of TZ{L), where 
L = I — P, and the linear span of the vector 1 consisting of ones. We studied the properties of the method 
and obtained an interpretation of the resulting weights of agents in terms of spanning out-trees in the 

oo 

communication digraph. It is shown that the resulting matrix P = P°°S of the orthogonal projection 
procedure, where S is the orthogonal projection onto Tp and = lim/fc_5.oo -P'^, can be considered as 
the regularized power limit of the stochastic matrix P. 
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Proof of Theorem [B From LI = it follows that 1 G M{L), and by ([U]), 1 ^ 7^(L). Therefore, the 
sum of TZ{L) and Ti is direct. Suppose that a vector of initial opinions x belongs to TZ{L) © Ti. Then 
X = V + al, where v £ TZ{L) and a G M. By ([7]), = P°^{v + al) = al, i.e., consensus is achieved: 

X G Tp. 

Suppose now that for a vector of initial opinions x, a consensus is achieved: x G Tp. Then P°°x = al 
for some a G M. Since = 1, we have - al) = 0, from which x - al G AA(P°°). By dS]) 

J\fiP°°) = TZ{L), therefore, x — al G TZ{L). Consequently, for some v G TZ{L) we have j; = v + al, and so 

xG7^(L)©^l. □ 

Proof of Corollary [2j According to ([9]), rankL = n — u. \n. the proof of Proposition 11 in [22], it is 

shown that the diagonal block of L corresponding to the union of the nonbasic bicomponents of T has 
full rank. On the other hand, each diagonal block Li corresponding to a basic bicomponent has rank 
one less than its order and the sum of the columns of this block is 0. Therefore, constructing a maximal 
set of linearly independent columns of L and having chosen all columns corresponding to the nonbasic 
bicomponents, among the columns corresponding to any basic bicomponent, one can reject no more than 
one, thus, exactly one column, since the number of rejected columns must be v. In the representation of 
the rejected column corresponding to the ith basic bicomponent by a linear combination of a maximal set 
of independent columns, the coefficients of the columns that correspond to the rth bicomponent are —1. 
Thus, removing from L a single arbitrary column for each basic bicomponent and adding all "nonbasic" 
columns, we obtain a maximal set of linearly independent columns of L. Owing to Theorem[Tl for matrix 
U composed of a maximal set of linearly independent columns of L and the column 1, we have 1Z{U) = Tp. 
□ 

Proof of Theorem [2j Since the nonbasic vertices correspond to the inessential states of the Markov 
chain determined by P, P°° has the form (* 0), where block consists of n — 6 columns jl31 (102) in 

Chapter 13]. According to S={^^ , therefore, P = P°°S, as weU as P°°, has the form (* 0). 

Using (pOj) we obtain a = (ai, . . . , at,, 0, . . . , 0)'^. 

By virtue of dS]) the upper left blocks of order 6 of P^^ P^ ... and P~ are (P<B)^ {P<sf,... and (P<b)°°, 

respectively. Using (f23]l we obtain that the upper left block of order b of P = P°°S is {P<b)°°Sss, which 
completes the proof of Theorem[2l □ 

Proof of Lemma [TJ We first prove that q^,. . . ,q'^ are linearly independent. Indeed, in the opposite 
case, '}2!i=2 ^i't — 0' where some coefficients are nonzero. Let j = min {i \ ai ^ 0}. Then by definition, 
ajq^ contains the nonzero components of ajTT^~^, while the corresponding components of all vectors 
with i > j are equal to zero. We obtain that J2i=2 ^iQ^ 7^ which proves the linear independence of 
q'',...,q\ 

Let q^ he 1, the column of n ones. Assume that q^,q'^, . . . ,q'^ are dependent. Then q^ = X!fc=2 o^kQ^ for 
some 02, . . . {as q"^, . . . ,q'^ are independent). Since the first mi components of q^ are positive and the 
corresponding components of (/* are equal to zero for i > 2, we have a2 > 0. The next m2 components are 
negative in g^, positive in q'^, and equal to zero in the remaining vectors g*, therefore, Q3 > 0. Proceeding 
by induction we obtain ai, > 0. On the other hand, the last rriu components of q'^ are negative, which 
contradicts q^ = Yl!k=2 o^kl^ ■ Thus, q^, . . . ,q'^ are linearly independent. 

By definition, q^,...,q'' G 7^(-P~). According to n{P°°) = M{L). Hence, G M{L). 

Furthermore, q^ G Af{L) as LI = 0. Thus, the whole set of columns of Z consists of the vectors q^, . . . ,q'^ 
forming a linearly independent subset in M{L) and a collection of linearly independent columns of L that 
belong to TZ{L). Finally, by ([TT]) . J\f{L) mz{L) = {0}. Therefore, the columns of Z are independent and 
Z is nonsingular. □ 
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Proof of Theorem [H 

1. Consider Eq. (j30p . It follows from the definition of X, stochasticity of P°°, and the identity 
P°°L = d?]) that the first column of P^X consists of ones, while the remaining columns consist of 
zeros. Therefore, each row of the resulting matrix P°°XZ~^ = Xa^ is equal to the first row of Z^^ . 

2. To prove this assertion, we use the following lemma. 

Lemma A.l. // all the entries in the first column of A £ C^x" are equal to 1 and A is invertible, then 
^-il = (l,0,...,0)T. 

Proof of Lemma lA.li By A^^ we denote the cofactor of the element Uij of A. Let be the sum of 
the entries in the fcth row of A~^. Under the assumptions of Lemma fA.H the expansion of det^ along 
the first column yields 

By M'\^ and M^^l*^™ we denote the minor of A obtained by removing row i and column k and the 
minor obtained by removing rows i and j and columns k and m, respectively. Expanding the minors 
M*!'^ of order n — 1 along the first column, for A; > 1 we obtain 

n n i— 1 n 

cTfcdet^ = ^(-iy+'=M*l'= = ^(-iy+'=(^(-l)^+JM'jl^'= + i-'^YM'^^^^y (A.l) 

1=1 i=l j=l j=i+l 

For any i,j G {1, . . . , n} such that j < i, the minor M^^^^^ enters the sum ()A.ip with the sign (— 

while the minor M^'^^^^ (having the same value) enters it with the sign (—1)-'^'^'"'"*. Hence, these minors 

cancel out. Consequently, if detA ^ and /c > 1, then Cfc = holds. The lemma is proved. □ 

Corollary A.l (of Lemma fA.ip . // all the entries in the kth column of A £ £nxn equal to y (z C 
and A is invertible, then A"^! = (0, . . . , 0, y~^, 0, . . . , 0)""", where is the kth component of the vector. 

Corollarv lA.il is obvious. 

Now we prove item 2 of Theorem[3j The identity J27=i c^i = 1 was proved in the last paragraph of 
Section^ Since the first column of Z consists of ones, the row sums of Z~^, except for the sum of the 
first row (which is equal to 1), are equal to zero by Lemma FA.li 

It remains to prove the positivity of the elements of the first row of Z~^. Denote by and the 
total weight of all spanning out-trees of the ith bicomponent of T and the total weight of those of them 
that are rooted at the kth. vertex of the ith bicomponent, respectively. According to the matrix tree 
theorem (see, e.g.. Theorem VI. 27 in |16j or Theorem 16.9' in [15], which is formulated for the matrix L^^ 
and unweighted digraphs) is equal to the cofactor of any element in the kth. row of Lj (see ([^Sjl ). Let 
Wi be the determinant of the matrix obtained from Lj by replacing the first column by the vector vr*. 
Expanding Wi along the first column and using (jl6p we obtain 

k=l k=l k=l 

Find the cofactors Z^^ {h = 1, . . . ,n) of the elements in the first column of Z (see (j28p ). Here, we 

represent the number h of the row in the form h = X]«=i ^ "^m + f^ih), where c{h) is the number of the 
basic bicomponent containing vertex h and k{h) is the number of this vertex in the bicomponent with 
number c{h). Let Z^^^^ be the matrix Z after deleting the kth row and the first column. To find 

Z^^ = (-1)'^+^ det Z^''^\ (A.2) 
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m we sequentially move each column g""*"^ (where u = 1, . . . , c{h) — 1) rriu — 1 steps to the left (if 

c{h) = 1, then no columns are moved). Denoting the resulting determinant by Z'*^, we have 

detZ^''^^ = (-1)EJ^S~'(™"-1)^^1 = f^_i^h~k{h)-{c{h)-l) 2;hi _ (^^^3^) 

Furthermore, the determinant Z^^ is equal to the product of its diagonal sub determinants of orders 
mi, . . . , rnc(h)-ij^c{h) ~ !> '^c{h)+ii • • • i "z^, since the products containing other elements of the columns 
(including the columns that were moved) are equal to zero. Consequently, 

C(h)-1 I, 

^^^1= n w.(-i)'^('^)+^4',^)(-i)^-^(") n w^.=(-ir'^'^+'^'^+'di (A.4) 

it=l u=c{h)+l u^c{h) 

where the factor (^—\Y~^W appears due to the negativity of the first columns of the last v — c{h) diagonal 
sub determinants. Substituting (IA.4P into (IA.3P and (]A.3p into (|A.2p we obtain 

From (lA.Sp and item 1 of Theorem[3] it follows that the signs of all components of a are the same; 
note that t^^^jl-^ are nonzero. Since, as shown in Section[6l the sum of the components of a is equal to 1, 
all these components are positive. 

Prove item 3 of Theorem[3j For simplicity, we use the following notation: i = c{g), j = c{h), k = k{g), 
and r = k{h). Due to item 1 of Theorem[3l (lA.Sp and (I16p . we have 

from which, in particular, we obtain the desired statement. The theorem is proved. □ 
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